hourly_weather_2022

Dataset statistics

Number of variables	7
Number of observations	17472
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	1.1 MiB
Average record size in memory	64.0 B

Variable types

DateTime	2
TimeSeries	5

Timeseries statistics

Number of series	5
Time series length	17472
Starting point	2022-01-01 00:00:00
Ending point	2023-12-30 23:00:00
Period	1 hour and 5.89 seconds

Original
Scaled

Alerts

`dhi` is highly overall correlated with `dni` and 1 other fields	High correlation
`dni` is highly overall correlated with `dhi` and 1 other fields	High correlation
`ghi` is highly overall correlated with `dhi` and 1 other fields	High correlation
`temp` is non stationary	Non stationary
`wind_spd` is non stationary	Non stationary
`dhi` is non stationary	Non stationary
`ghi` is non stationary	Non stationary
`dni` is non stationary	Non stationary
`temp` is seasonal	Seasonal
`wind_spd` is seasonal	Seasonal
`dhi` is seasonal	Seasonal
`ghi` is seasonal	Seasonal
`dni` is seasonal	Seasonal
`timestamp_utc` has unique values	Unique
`dhi` has 8632 (49.4%) zeros	Zeros
`ghi` has 8672 (49.6%) zeros	Zeros
`dni` has 8654 (49.5%) zeros	Zeros

Reproduction

Analysis started	2024-05-06 07:39:32.030265
Analysis finished	2024-05-06 07:39:40.307004
Duration	8.28 seconds
Software version	ydata-profiling vv4.7.0
Download configuration	config.json

timestamp_local
Date

Distinct	17470
Distinct (%)	> 99.9%
Missing	0
Missing (%)	0.0%
Memory size	273.0 KiB

Minimum	2022-01-01 00:00:00
Maximum	2023-12-30 23:00:00

Histogram

Histogram with fixed size bins (bins=50)

timestamp_utc
Date

UNIQUE

Distinct	17472
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Memory size	273.0 KiB

Minimum	2021-12-31 23:00:00
Maximum	2023-12-30 22:00:00

Histogram

Histogram with fixed size bins (bins=50)

temp
Numeric time series

NON STATIONARY SEASONAL

Distinct	322
Distinct (%)	1.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	18.098094
Minimum	-0.5
Maximum	34.7
Zeros	0
Zeros (%)	0.0%
Memory size	273.0 KiB

Quantile statistics

Minimum	-0.5
5-th percentile	6.7
Q1	12.7
median	18
Q3	24.025
95-th percentile	28.8
Maximum	34.7
Range	35.2
Interquartile range (IQR)	11.325

Descriptive statistics

Standard deviation	6.9540729
Coefficient of variation (CV)	0.38424338
Kurtosis	-0.9045947
Mean	18.098094
Median Absolute Deviation (MAD)	5.6
Skewness	-0.078815103
Sum	316209.9
Variance	48.35913
Monotonicity	Not monotonic
Augmented Dickey-Fuller test p-value	0.1805122332

Histogram with fixed size bins (bins=50)

Gap statistics

number of gaps	1
min	1 day and 1 hour
max	1 day and 1 hour
mean	1 day and 1 hour
std	0

Value	Count	Frequency (%)
14.7	217	1.2%
15	196	1.1%
26	194	1.1%
12.2	190	1.1%
14.2	188	1.1%
14	178	1.0%
13.2	176	1.0%
14.5	172	1.0%
15.5	170	1.0%
12.5	168	1.0%
Other values (312)	15623	89.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-0.5	2	< 0.1%
-0.2	1	< 0.1%
0.1	1	< 0.1%
0.2	1	< 0.1%
0.5	5	< 0.1%
0.7	1	< 0.1%
1	3	< 0.1%
1.1	1	< 0.1%
1.5	2	< 0.1%
1.6	4	< 0.1%

Value	Count	Frequency (%)
34.7	2	< 0.1%
34.4	1	< 0.1%
34.2	1	< 0.1%
34	1	< 0.1%
33.8	1	< 0.1%
33.7	2	< 0.1%
33.6	3	< 0.1%
33.5	1	< 0.1%
33.4	1	< 0.1%
33.1	2	< 0.1%

ACF and PACF

wind_spd
Numeric time series

NON STATIONARY SEASONAL

Distinct	133
Distinct (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	4.1028028
Minimum	0
Maximum	15.9
Zeros	1
Zeros (%)	< 0.1%
Memory size	273.0 KiB

Quantile statistics

Minimum	0
5-th percentile	1
Q1	2.6
median	3.6
Q3	5.09
95-th percentile	8.19
Maximum	15.9
Range	15.9
Interquartile range (IQR)	2.49

Descriptive statistics

Standard deviation	2.1834863
Coefficient of variation (CV)	0.53219382
Kurtosis	1.8332907
Mean	4.1028028
Median Absolute Deviation (MAD)	1
Skewness	1.0922296
Sum	71684.17
Variance	4.7676124
Monotonicity	Not monotonic
Augmented Dickey-Fuller test p-value	3.78182106 × 10^-23

Histogram with fixed size bins (bins=50)

Gap statistics

number of gaps	1
min	1 day and 1 hour
max	1 day and 1 hour
mean	1 day and 1 hour
std	0

Value	Count	Frequency (%)
3.6	2001	11.5%
3.1	1935	11.1%
4.09	1751	10.0%
2.6	1561	8.9%
4.59	1442	8.3%
2.1	1384	7.9%
5.09	1214	6.9%
1	935	5.4%
6.2	851	4.9%
1.5	847	4.8%
Other values (123)	3551	20.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1	< 0.1%
0.25	1	< 0.1%
0.33	1	< 0.1%
0.4	12	0.1%
0.5	203	1.2%
0.72	1	< 0.1%
0.75	1	< 0.1%
0.8	13	0.1%
0.87	1	< 0.1%
1	935	5.4%

Value	Count	Frequency (%)
15.9	1	< 0.1%
15.4	2	< 0.1%
14.4	8	< 0.1%
13.9	9	0.1%
13.4	23	0.1%
12.9	25	0.1%
12.4	3	< 0.1%
12.3	32	0.2%
11.85	1	< 0.1%
11.8	31	0.2%

ACF and PACF

dhi
Numeric time series

HIGH CORRELATION NON STATIONARY SEASONAL ZEROS

Distinct	124
Distinct (%)	0.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	42.858288
Minimum	0
Maximum	123
Zeros	8632
Zeros (%)	49.4%
Memory size	273.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	8.5
Q3	91
95-th percentile	118
Maximum	123
Range	123
Interquartile range (IQR)	91

Descriptive statistics

Standard deviation	47.37767
Coefficient of variation (CV)	1.1054494
Kurtosis	-1.5564483
Mean	42.858288
Median Absolute Deviation (MAD)	8.5
Skewness	0.41366257
Sum	748820
Variance	2244.6436
Monotonicity	Not monotonic
Augmented Dickey-Fuller test p-value	0.9044002042

Histogram with fixed size bins (bins=50)

Gap statistics

number of gaps	1
min	1 day and 1 hour
max	1 day and 1 hour
mean	1 day and 1 hour
std	0

Value	Count	Frequency (%)
0	8632	49.4%
122	232	1.3%
117	218	1.2%
121	216	1.2%
109	170	1.0%
118	164	0.9%
110	162	0.9%
116	156	0.9%
99	156	0.9%
112	152	0.9%
Other values (114)	7214	41.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	8632	49.4%
1	12	0.1%
2	12	0.1%
3	12	0.1%
4	18	0.1%
5	8	< 0.1%
6	18	0.1%
7	10	0.1%
8	14	0.1%
9	20	0.1%

Value	Count	Frequency (%)
123	140	0.8%
122	232	1.3%
121	216	1.2%
120	120	0.7%
119	136	0.8%
118	164	0.9%
117	218	1.2%
116	156	0.9%
115	124	0.7%
114	110	0.6%

ACF and PACF

ghi
Numeric time series

HIGH CORRELATION NON STATIONARY SEASONAL ZEROS

Distinct	983
Distinct (%)	5.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	232.08883
Minimum	0
Maximum	991
Zeros	8672
Zeros (%)	49.6%
Memory size	273.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	3
Q3	437
95-th percentile	878
Maximum	991
Range	991
Interquartile range (IQR)	437

Descriptive statistics

Standard deviation	308.20304
Coefficient of variation (CV)	1.3279529
Kurtosis	-0.33968156
Mean	232.08883
Median Absolute Deviation (MAD)	3
Skewness	1.0316001
Sum	4055056
Variance	94989.115
Monotonicity	Not monotonic
Augmented Dickey-Fuller test p-value	0.6957092143

Histogram with fixed size bins (bins=50)

Gap statistics

number of gaps	1
min	1 day and 1 hour
max	1 day and 1 hour
mean	1 day and 1 hour
std	0

Value	Count	Frequency (%)
0	8672	49.6%
64	32	0.2%
370	32	0.2%
894	30	0.2%
1	30	0.2%
869	28	0.2%
191	28	0.2%
2	28	0.2%
770	28	0.2%
991	26	0.1%
Other values (973)	8538	48.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	8672	49.6%
1	30	0.2%
2	28	0.2%
3	24	0.1%
4	12	0.1%
5	16	0.1%
6	18	0.1%
7	18	0.1%
8	10	0.1%
9	16	0.1%

Value	Count	Frequency (%)
991	26	0.1%
990	14	0.1%
989	10	0.1%
988	8	< 0.1%
987	6	< 0.1%
986	6	< 0.1%
985	6	< 0.1%
984	6	< 0.1%
983	4	< 0.1%
982	4	< 0.1%

ACF and PACF

dni
Numeric time series

HIGH CORRELATION NON STATIONARY SEASONAL ZEROS

Distinct	805
Distinct (%)	4.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	349.05357
Minimum	0
Maximum	924
Zeros	8654
Zeros (%)	49.5%
Memory size	273.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	26.5
Q3	767
95-th percentile	903
Maximum	924
Range	924
Interquartile range (IQR)	767

Descriptive statistics

Standard deviation	380.44115
Coefficient of variation (CV)	1.0899219
Kurtosis	-1.7101447
Mean	349.05357
Median Absolute Deviation (MAD)	26.5
Skewness	0.32548006
Sum	6098664
Variance	144735.47
Monotonicity	Not monotonic
Augmented Dickey-Fuller test p-value	0.9073866562

Histogram with fixed size bins (bins=50)

Gap statistics

number of gaps	1
min	1 day and 1 hour
max	1 day and 1 hour
mean	1 day and 1 hour
std	0

Value	Count	Frequency (%)
0	8654	49.5%
893	98	0.6%
915	88	0.5%
914	80	0.5%
857	62	0.4%
920	62	0.4%
870	60	0.3%
913	54	0.3%
919	54	0.3%
892	52	0.3%
Other values (795)	8208	47.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	8654	49.5%
1	10	0.1%
2	4	< 0.1%
3	8	< 0.1%
5	12	0.1%
6	2	< 0.1%
7	2	< 0.1%
8	2	< 0.1%
9	2	< 0.1%
11	2	< 0.1%

Value	Count	Frequency (%)
924	38	0.2%
923	42	0.2%
922	28	0.2%
921	24	0.1%
920	62	0.4%
919	54	0.3%
918	40	0.2%
917	38	0.2%
916	30	0.2%
915	88	0.5%

ACF and PACF

Auto

Heatmap
Table

	dhi	dni	ghi	temp	wind_spd
dhi	1.000	0.999	0.999	0.385	0.330
dni	0.999	1.000	0.999	0.380	0.330
ghi	0.999	0.999	1.000	0.392	0.328
temp	0.385	0.380	0.392	1.000	-0.001
wind_spd	0.330	0.330	0.328	-0.001	1.000

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows
Last rows

	timestamp_local	timestamp_utc	temp	wind_spd	dhi	ghi	dni
2022-01-01 00:00:00	2022-01-01 00:00:00	2021-12-31 23:00:00	10.7	1.0	0	0	0
2022-01-01 01:00:00	2022-01-01 01:00:00	2022-01-01 00:00:00	10.7	2.6	0	0	0
2022-01-01 02:00:00	2022-01-01 02:00:00	2022-01-01 01:00:00	10.7	2.6	0	0	0
2022-01-01 03:00:00	2022-01-01 03:00:00	2022-01-01 02:00:00	10.2	2.6	0	0	0
2022-01-01 04:00:00	2022-01-01 04:00:00	2022-01-01 03:00:00	10.5	1.5	0	0	0
2022-01-01 05:00:00	2022-01-01 05:00:00	2022-01-01 04:00:00	10.5	1.5	0	0	0
2022-01-01 06:00:00	2022-01-01 06:00:00	2022-01-01 05:00:00	10.5	2.6	0	0	0
2022-01-01 07:00:00	2022-01-01 07:00:00	2022-01-01 06:00:00	10.0	1.0	0	0	0
2022-01-01 08:00:00	2022-01-01 08:00:00	2022-01-01 07:00:00	8.0	1.5	0	0	0
2022-01-01 09:00:00	2022-01-01 09:00:00	2022-01-01 08:00:00	8.6	1.0	39	64	340

	timestamp_local	timestamp_utc	temp	wind_spd	dhi	ghi	dni
2023-12-30 14:00:00	2023-12-30 14:00:00	2023-12-30 13:00:00	15.2	2.10	87	382	745
2023-12-30 15:00:00	2023-12-30 15:00:00	2023-12-30 14:00:00	14.2	3.60	79	298	686
2023-12-30 16:00:00	2023-12-30 16:00:00	2023-12-30 15:00:00	14.0	3.60	62	176	559
2023-12-30 17:00:00	2023-12-30 17:00:00	2023-12-30 16:00:00	13.2	4.09	32	41	259
2023-12-30 18:00:00	2023-12-30 18:00:00	2023-12-30 17:00:00	12.2	3.60	0	0	0
2023-12-30 19:00:00	2023-12-30 19:00:00	2023-12-30 18:00:00	11.2	2.10	0	0	0
2023-12-30 20:00:00	2023-12-30 20:00:00	2023-12-30 19:00:00	10.7	2.60	0	0	0
2023-12-30 21:00:00	2023-12-30 21:00:00	2023-12-30 20:00:00	10.7	3.10	0	0	0
2023-12-30 22:00:00	2023-12-30 22:00:00	2023-12-30 21:00:00	10.6	4.59	0	0	0
2023-12-30 23:00:00	2023-12-30 23:00:00	2023-12-30 22:00:00	7.7	1.00	0	0	0

Overview

Variables

Interactions

Correlations

Missing values

Sample